MULTI-OBJECTIVE LINEAR QUADRATIC TEAM OPTIMIZATION * 

ATHER GATTAMI t 

Abstract. In this paper, we consider linear quadratic team problems with an arbitrary number 
of quadratic constraints in both stochastic and deterministic settings. The team consists of players 
with different measurements about the state of nature. The objective of the team is to minimize a 
quadratic cost subject to additional finite number of quadratic constraints. We will first consider the 
Gaussian case, where the state of nature is assumed to have a Gaussian distribution, and show that 
the linear decisions are optimal and can be found by solving a semidefinite program We then consider 
the problem of minimizing a quadratic objective for the worst case scenario, subject to an arbitrary 
number of deterministic quadratic constraints. We show that linear decisions can be found by solving 
a semidefinite program. 
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1. Introduction. We consider the problem of distributed decision making 
with information constraints under linear quadratic settings. For instance, in- 
formation constraints appear naturally when making decisions over networks. 
These problems can be formulated as team problems. The team problem is an 
optimization problem with several decision makers possessing different informa- 
tion aiming to optimize a common objective. Early results in HUH considered 
static team theory in stochastic settings and a more general framework was 
introduced by Radner II12L where existence and uniqueness of solutions where 
shown. Connections to dynamic team problems for control purposes where intro- 
duced in 0. In (4), the team problem with two team members was solved. The 
solution cannot be easily extended to more than two players since it uses the fact 
that the two members have common information; a property that doesn't neces- 
sarily hold for more than two players. Also, a nonlinear team problem with two 
team members was considered in [2 ], where one of the team members is assumed 
to have full information whereas the other member has only access to partial in- 
formation about the state of the world. Related team problems with exponential 
cost criterion were considered in [10]. Optimizing team problems with respect 
to affine decisions in a minimax quadratic cost was shown to be equivalent to 
stochastic team problems with exponential cost, see (H. The connection is not 
clear when the optimization is carried out over nonlinear decision functions. The 
deterministic version (minimizing the worst case scenario) of the linear quadratic 
team decision problem was solved in (8). 

In this paper, we will consider both Gaussian and deterministic settings(worst 
case scenario) for team decision problems under additional quadratic constraints. 
It's well-known that additional constraints, although convex, could give rise to 
complex optimization problems if the optimized variables are functions (as op- 
posed to real numbers). For instance linear functions, that is functions of the 
form fi(x) = Kx where K is a real matrix, are no longer optimal. We will illus- 
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trate this fact by the following example: 

EXAMPLE 1. For x e M, we want to minimize the objective function 



subject to 



u\ 2 < 7 



Some Hilbert space theory shows that the optimal u is given by 



u = fi(x) = (\x\ - y/i)x/\x\ if \x\ 2 > 7, 

and 

u = /j,(x) = otherwise. 
Obviously, the optimal uis a nonlinear function of x. 

Increasing the dimension of x, and adding constraints on the structure of 
u, for instance x e R w and u = fj,(x) = (fJ,(xi), .., ^{xn)), certainly makes the 
constrained optimization more complicated. The example above shows that, in 
spite of having a convex optimization carried out over a Hilbert space, the optimal 
decision function is nonlinear. However, we show in the upcoming sections that 
multi-objective problems behave nicely when considering the expected values of 
the objectives in the Gaussian case, in the sense that linear decisions are optimal. 
For the deterministic counterpart which is not an optimization problem over a 
Hilbert space, we show how to find the linear optimal decisions by semidefinite 
programming. However, the optimality of the linear decisions remains and open 
question. 

2. Notation. The following table gives a list of the notation we are going to 
usee throughout the text: 



S™ The set of n x n symmetric matrices. 

S™ The set of n x n symmetric positive 

semidefinite matrices. 
§" + The set of n x n symmetric positive 

definite matrices. 
M The set of measurable functions. 

C The set of functions fi : R p M m with 

My) = (miXj/i)) ^(2/2), ^{vm)) 7 ', 

Hi : RP* -> R™% J2 t m t = m, ^Pi = V- 
[A]ij The element of A in position 

y Ah B A- B eSf. 

>- Ay B <^ A- B 

® The Kronecker binary operation 

between two matrices A and B, A <g> B. 
Tr Tr[A] is the trace of the matrix A. 



N{m, X) The set of Gaussian variables with 
mean m and covariance X. 
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3. Linear Quadratic Gaussian Team Theory. In this section we will re- 
view some classical results in stochastic team theory with new simpler proofs for 
the linear quadratic case, that first appeared in [6] and O. 

In the static team decision problem, one would like to solve 



(3.1) 



X 


T 


Qxx Qxu 




X 


u 




Qux Quu 




II 



min E 
subject to yi — CiX + Vi 

for i = l,...,N. 

Here, x and v are independent Gaussian variables taking values in M™ and W, 
respectively, with x ~ Af(0, V xx ) and v ~ 7V(0, V vv ). Also, yt and u.t will be stochas- 
tic variables taking values in K Pi , K m< , respectively, and p\ + ... + pn = p- We 
assume that 



XX 

ux 



Qxu 
Quu 



(3.2) 



and Q uu e §++, m = mi + ■■ ■ + m N . 

If full state information about x is available to each decision maker the 
minimizing u can be found easily by completion of squares. It is given by u = Lx, 
where L is the solution to 



QuuL — Qux- 

Then, the cost function in d3.ll * can be rewritten as 

J{x, u) = V{x T {Q xx - L T Q uu L)x] + E{{u - Lx) T Q uu {u - Lx)}. (3.3) 
Minimizing the cost function J(x, u), is equivalent to minimizing 

E{(u - Lx) T Quu(u - Lx)}, 

since nothing can be done about ~E{x T (Q X x — L T Q U uL)x} (the cost when u has full 
information). 

The next theorem is due to Radner 11121 . but we give a different formulation 
and proof that is simpler, which relies on the structure of the linear quadratic 
Gaussian setting: 

THEOREM 1. Let x and Vi be Gaussian variables with zero mean, taking 
values in K" and M Pi , respectively, with p\ + ... +pn = P- Also, let u.i be a stochastic 

variable taking values in R m \ Q uu € §™ + , m = mi H + mjv, L e K mxn , d € 

W iXn , for i=l,...,N. Then, the optimal decision [i to the optimization problem 

min E{(u — Lx) T Q U u(u — Lx)} 

subject to i/i = CiX + Vi ^ ^ 

Ui = fJ-i(Ui) 

fori = 1,...,N. 



is unique and linear in y. 
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Proof. Let Z be the linear space of functions such that z £ Z if Zj is a linear 
transformation of y^, that is Zi — A^ for some real matrix A t £ ^ m i x Pi_ Since 
Q uu >~ 0, Z is a linear space under the inner product 

(g, h) = E{g T Q uu h}, 

and norm 

\\g\\ 2 = -E{g T Q uu g}. 

The optimization problem in ( 13.41 1 where we search for the linear optimal decision 
can be written as 

min 1 1 zi — Lx\\ 2 (3.5) 

Finding the best linear optimal decision u* e Z to the above problem is equiv- 
alent to finding the shortest distance from the subspace Z to the element Lx, 
where the minimizing u* is the projection of Lx on Z, and hence unique. Also, 
since [i* is the projection, we have 

= (u* — Lx, fi) = E{(«* — Lx) T Q uu u}, 

for all u e Z. In particular, for /, = (0, 0, z l , 0, 0) € Z, we have 

E{(u* - Lx) T Quufi} = E{[(«* - Lx) T Q uu ] lZi } = 0. 

The Gaussian assumption implies that [(u*(y) — Lx) T Q uu ]t is independent of z t = 
Aiyi, for all linear transformations Ai. This gives in turn that [{u* — Lx) T Q uu ]i 
is independent of y l . Hence, for any decision fi £ M n C, linear or nonlinear, we 
have that 

E(u* - Lx) T Q uuf i(y) = J] E{[(u* - Lx) T Q Mn ]^(^)} = 0, 

i 

and 

EO(y)-Lx) 7 'Quu(v(y) - Lx) 

= E(u* ~Lx + n(y) - u*) T Q uu {u* - Lx + fi(y) - u*) 

= E(m* - Lx) T Q uu (u* - Lx) + E( M (y) - u*) T Q««(M2/) - u*) 

+ 2E(u* - Lx) T Q uu (fi(y) - u*) 

= E(u* - Lz) T <2 u „(u* - Lx) + E(/i(y) - u*) T <2«« - u*) 
> E(u* -Lx) T Q uu (u* ~Lx) 

with equality if and only if fj,(y) = u*. This concludes the proof. 
□ 

PROPOSITION 1, Let x and v t be independent Gaussian variables taking val- 
ues in 1" and W\ respectively with x ~ Af(0,V xx ), v ~ A/"(0, V vv ). Also, let 
be a stochastic variable taking values in R m % m = mi + ■ ■ ■ + mjv, Q xu G M. nxm , 
Quu € C\ £ M P!Xn , and L = -Q^uQux- Set yi = CiX + Uj. TTierc, the optimal 
solution Ki,..., K N to the optimization problem 



min E(it — Lx) Q U u(u — Lx) 



subject to Ui = Kiyi 

fori = l,...,N. 



(3.6) 
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is the solution of the linear system of equations 



N 



JsjCA-.J-! + [V vv ] 3l ) = -[Q ux ]iV xx Cf , for % = 1, ...,N. (3.7) 

3=1 



Proof Let K = diag(ifi, ...,K N ) and C = [Cf 



C 



The problem of 



finding the optimal linear feedback law Ui — K l y l can be written as 

min Tr[E{Q uu (u - Lx)(u - Lx) T }] 

Ki 

subject to u = K(Cx + v) 
Now 

f{K) = Tr E{Q„„(u - Lx)(u - Lxf} 

= Tr E{Q uu (KCx + Kv - Lx)(KCx + Kv - Lx) T } 
= Tr [E{Q uu K(Cxx T C T + vv T )K T ~ 2Q uu Lxx T C T K T 
+Q uu Lxx T L T + 2Q UU (KC - L)xv T K T }] 

= Tr [Q UU K(CV XX C T + V VV )K T - 2Q UU LV XX C T K T + Q UU LV XX L T )] 

N N 

y ] [Quu]ij Kj(CjV xx C i + [T^^jji)^ — 2 y ' [Qnujjj LjV xx Ci Ki 



(3.8) 



Tr 



'■j=i 



',3=1 



TrlQuuLVxxL 1 



(3.9) 



(3.10) 



A minimizing K is obtained by solving Vxif{K) = 0: 
= V K J(K) 

N N 

= ^ [Quu]ij KjiCjVxxCi + [V vv ]ji) — 2^^[Q uu \ijLjV xx Ci . 

3 = 1 3 = 1 

Since Q U uL — —Q ux , we get that 

^^/j = l[Quu\ij LjV xx Ci — \Q ux\iVxxC ^ , 

and the equality in ( 13.101 * is equivalent to 

and the proof is complete. □ 

In general, separation does not hold for the static team problem when con- 
straints on the information available for every decision maker m are imposed. 
That is, the optimal decision is not given by ui = Lii, where £i is the optimal 
estimated value of x by decision maker i. We show it by considering the following 
example. 

EXAMPLE 2. Consider the team problem 



minimize E 



X 


T 


Qxx Qxu 




X 


u 




Qux Quu 




U 



subject to yi — CiX + v t 
Ui = Hi{yi) 
fori = 1,...,N 
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The data we will consider is: 



N = 2, d=C 2 = l, x~M(0,l), vi ~JV(0,1), V2~M(fi,l) 



Q, 



2 1 
1 2 



[l 1] 



The best decision with full information is given by 



- 2 


1" 




T 
1 




' 1" 




\ 


2^ 




X = 


! 




. 3 


3 _ 






.3. 





T/ie optimal estimate of x of decision maker 1 is 



and of decision maker 2 



xi = E{x\yi\ = -yi, 



x 2 = E{x\y 2 } = -J/2- 



Hence, the decision where each decision maker combines the best deterministic 
decision with her best estimate of x is given by 



1 



1 



3 Xl ~ 6 Vu 



for i = 1,2. This policy gives a cost equal to 0.611. However, solving the team 
problem yields K\ = K% = |, and hence the optimal team decision is given by 



Ui = -yi. 
5 

The cost obtained from the team problem is 0.600. Clearly, separation does not 
hold in team decision problems. 

4. Team Decision Problems with Power Constraints. Consider the mod- 
ified version of the optimization problem d3.ll >: 



(4.1) 



X 


T 


Q S~ 




X 


u 




S T R 




u 



min E 

A" 

subject to yi — CiX 

Ui = ^i{yi) 

fori = l,...,N. 

The difference from Radner's original formulation is that we have added power 
constraints to the decision functions, 7* > E||^j(j/j)|| 2 , 

In optimization (minimization) problems, you define the value to be infinite 
if there doesn't exist any feasible decision variable that satisfy the constraints. 
Therefore, usually, one assumes that there is a feasible point, and hence the 
value must be finite. Existence conditions are hard to derive usually in spite 
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of problems might be convex. So in practice, you run the algorithm and either 
you get a finite number, or it goes indefinitely. Conditions where you a decide 
whether you have a feasible problem or not are of great interest of course. It's a 
nontrivial problem that is outside the scope of this paper. 

In the sequel, we will prove a more general theorem, where we consider 
power constraints on a set of quadratic forms in both the state x and the decision 
function /i. 

THEOREM 2. Let x be a Gaussian variable with zero mean and given co- 

Q S 

variance matrix X, taking values in W 1 . Also, let '"" " 

S 



G S? + '\ R G § 



++' 



Sj Rj 
problem 



G S m+n , and Rj G for j 



Sq i?0 

l,...,M. Assume that the optimization 



min E 



subject to E 



X 


T 


Qo Sq 




X 


_fi(x)_ 




Sq Rq 




ji{x)_ 


X 


T 


Qj Sj 




X 


_fi(x)_ 











< 



(4.2) 



is feasible. Then, linear decisions fi given by fi(x) = K{X)x, with K(X) G IK, are 
optimal. 

Proof. Consider the expression 



E 



X 


T 


'Qo 


So' 




X 


jj,(x)_ 




cT 


Ro 




jj,(x)_ 



M 

i=i 



E 



X 




Qj Sj 




X 




jj,(x)_ 








jj,(x)_ 



Take the expectation of a quadratic form with index j to be larger than jj . Then, 
Aj — > oo makes the value of the expression above infinite. On the other hand, 
if the expectation of a quadratic form with index j is smaller than 7 3 , then the 
maximizer Aj is optimal for Aj = 0. 

Now let p* be the optimal value of the optimization problem ( I4.2I >. and con- 
sider the objective function 



X 


T 


Qo 


So 




X 


u 




oT 

P o 


Ro 




u 



x 1 (Qo - S Ro L Si )x + {u- Rq L S^ x) 1 R (u - R^'S^ x) 



We have that Qo - SqR^S^ h 0, since it's the Schur complement of Rq in the 

la So 



positive semi-definite matrix 



oT 



Rc 



. Since R >- 0, a necessary condition for 



the objective function to be zero is that u = Rq^^S^x, and so u must be linear (In 
order for u to have the structure given by C, Rq 1 SI must be in K, to satisfy the 
information constraints). 
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Now assume that p* > 0. We have 



p — min max E 

ij.ee a ; gr + 



= min max E 

nee X;eR + 



x 
(j,(x) 

X 

n(x) 



Qo So 
Sq Ro 



Qo So 
So Ro 



x 



M 

+EM E 

3=1 



X 

fi(x) 



Sj Rj 



X 

H{x) 



M 

i=i 







X 


Sj Rj_ 




_n(x)_ 



Now introduce A and the matrix 



M 

E 

3=1 



7j 



(4.3) 



Q S 
S T R 



M 
3=0 



and consider the minimax problem 



Po = min max E 

nee \j>o 



a; 


T 


"Q S" 




a; 






5 T i? 







M 

Ev, 

3=1 



(4.4) 



Note that a maximizing A must be positive, since A = implies that p < 0, 
while A > gives p a > 0. We can always recover the optimal solutions of d4.3| l 
from that of A4.4D by dividing all variables by A , that is p* = p /X a , Xj i-> Xj/Xo, 
and fi h-> jtt/Ao. Now we have the obvious inequality (minmax{-} > maxmin{-}) 



Po > max min E 



re 

Ms) 



T / M 

E^ 

i=i 



x 



M 

E A ^- 

3=1 



For any fixed values of Aj, we have i? >~ 0, so Theorem [I] gives the equality 



min E 

tj.ec 



x 
H{x) 



Q S 
S T R 



x 



— min E 



X 

Kx 



Q S 
S T R 



x 
Kx 



where the minimizing K is unique. Thus, 



po > max min E 

\j>o iiec 



max min E 

Xj >o if GK 



x 
Kx 



E^ 
E^ 

3 = 



Qj Sj 
S a Rj 



Sj Rj 



x 



X 

Kx 



M 

-E A ^ 

3=1 
M 

E A "•• 

3 = 1 



The objective function is radially unbounded in K since R >- 0. Hence, it can be 
restricted to a compact subset of K. Thus, 
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1 M 

J 3=1 

M 

3=1 
1 M 
J 3=1 

where the equality is obtained by applying Proposition [2] in the Appendix, the 
second inequality follows from the fact that the set of linear decisions Kx, K £ K, 
is a subset of C, and the second equality follows from the definition of p a . Hence, 
linear decisions are optimal, and the proof is complete. □ 

Remark: Although Theorem 2 is stated and proved for y = x and u = fi(y) = 
£t(x), it extends easily to the case y = Cx for any matrix C, which often is the 
case in applications. 

5. Computation of The Optimal Team Decisions. The optimization prob- 
lem that we would like to solve when assuming linear decisions is 



Po > max min E 

\j>0 K£K 



min max E 

K&K Xj>0 



> min max E 




Qj Sj 

sT Ri 



/'( 





si 




X 


si 


Rj 


) 


Kx 




Sj 


) 


X 


k 


Rj 







mm 7o 



X 


T 


Qj 


si 




X 


KCx 




sj 


Rj_ 




KCx 



subject to E 

x -7V(0,X 2 ). 
Note that we can write the constraints as 

Qj Sj 

Sj R 3_ 



< 7j , j = 0,...,M, 



(5.1) 



E 



x 

KCx 



x 

KCx 



E <; Tr 



I 

KC 



i T r 



Qj Sj 
Sj Rj 



I 

KC 



= TrX 



I ' 


T 


-Qj 


si 




i ' 


KC 




sj 


R L 




KC 



(5.2) 



X, 



where we used that Ea;x T = X 2 . Hence, we obtain a set of convex quadratic 
inequalities (convex since Rj >z for all j) 



TrX 



' I ' 


T 


Qj 


si 




' i ' 


KC 




sj 


Rj_ 




KC 



X < 7J . 



There are many existing computational methods to solve convex quadratic opti- 
mization problems (see 0). 

Alternatively, we can formulate the optimization problem as a set of linear 
matrix inequalities as follows. For simplicity, we will assume that Rj >- for all 
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j (The case Rj >z is analogue with some technical conditions). 

THEOREM 3. The team optimization problem Hi5.1i is equivalent to the semi- 
definite program 



mm 7o 



subject to TrPj < jj 

~Pj - XQjX - XSjKCX - XC T K T SjX XC T K T R 



RjKCX 



(5.3) 



d 
j = 0,...,M. 

Proof. Introduce the matrices Pj € S", and write the given constraints as 



Pi -X 



Now we have that 

-< X 



' I ' 


T 


Qj 


si 




' / " 


KC 




sj 


R j_ 




KC 



' I ' 


T 




si 




' I ' 


KC 






Rj_ 




KC 



X 



x y o. 



(5.4) 



(5.5) 



Pj - XQjX - XSjKCX - XC T K T SfX - XC T K T RjKCX. 



Since Rj >- 0, the quadratic inequality above can be transformed to a linear 
matrix inequality using the Schur complement (1 3 1), which is given by 



Pj - XQjX - XSjKCX - XC T K T SjX XC T K T Rj 



RjKCX 



y o. 



Hence, our optimization problem to be solved is given by 



P 3 - XQjX - XSJKCX - XC T K T SjX XC T K T Rj 



RjKCX 



R i 



(5.6) 



mm 7n 

K£K 

subject to TrPj < jj 
d 
j = 0, M, 
which proves our theorem. □ 

6. Minimax Team Theory. We considered the problem of static stochastic 
team decision in the previous sections. This section treats an analogous version 
for the deterministic (or worst case) problem. Although the problem formulation 
is very similar, the ideas of the solution are considerably different, and in a sense 
more difficult. 

The deterministic problem considered is a quadratic game between a team 
of players and nature. Each player has limited information that could be differ- 
ent from the other players in the team. This game is formulated as a minimax 
problem, where the team is the minimizer and nature is the maximizer. 
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6.1. Deterministic Team Problems. Consider the following team decision 
problem 



inf sup 



J(x, u) 



a 1 x^o ipir 

subject to yi ~C t x 
Ui = m(yi) 
fori = 1,...,N 



(6.1) 



where Ui e W ni , m = mi + ■■■ + tun, Ci e 
J(x, u) is a quadratic cost given by 



J(x, u) 



X 


T 


Qxx Qxu 




X 


u 




Qux Quu 




U 



where 



; xx 
5 u x 



Quu 



e S 



We will be interested in the case Q uu >~ 0. The players u\,..., un make up a team, 
which plays against nature represented by the vector x, using /i e S, that is 



fj,(Cx) = 



Hi{Cix) 
/j, N {C N x) 



THEOREM 4. If the value of the game S6.1i is equal to 7*, then there is a linear 
decision fi(Cx) = KCx, with K — diag(K l7 K N ), achieving that value. 
Proof. For a proof, consult [8]. □ 

6.2. Relation with The Stochastic Minimax Team Decision Problem. 

Now consider the stochastic minimax team decision problem 



K Ell 



Taking the expectation of the cost in the stochastic problem above yields the 
equivalent problem 



{•' 


I ' 


T 


Qxx Qxu 




' I ' 


■1 


KC 




Qux Quu 




KC 



min max Tr 

K TrX = l 



I ' 


T 


Qxx Qxu 




' I ' 


KC 




Qux Quu 




KC 



X 



where X is a positive semi-definite matrix, and is the covariance matrix of x, i. e. 
X = E xx T . Hence, we see that the stochastic minimax team problem is equiva- 
lent to the deterministic minimax team problem, where nature maximizes with 
respect to all covariance matrices X of the stochastic variable x with variance 

E ||x|| 2 = E x T x = Tr X = 1. 

7. Deterministic Team Problems with Quadratic Constraints. Con- 
sider the team problem d6.ll *. An equivalent condition for the existence of a deci- 
sion function e C that achieves the value of the game 7* is that 



<7*NI 



X 


T 


Q S~ 




X 


Li*{Cx) 




S T R 




fi*{Cx) 
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for all x, which is equivalent to 



X 


T r 


ji*(Cx)_ 





Q-1*I S 
S T R 



x 

^(Cx) 



< 



for all x. This is an example of a power constraint. We could also have a set of 
power constraints that have to be mutually satisfied. For instance, in addition to 
the minimization of the worst case quadratic cost, we could have constraints on 
the induced norms of the decision functions 



^ l ff^ 2 < 7l forallx^O, i = l,..,M, 



or equivalently given by the quadratic inequalities 



||/ii(Cix)|| 2 - 7i||x|| 2 < for all x, i = l,...,M. 

Also, the team members could share a common power source, and the power is 
proportional to the squared norm of the decisions (if. 

M 

^||^(C 4 x)|| 2 -c||x|| 2 <0 for all x, 

i=l 

for some positive real number c. 

It's not clear whether linear decisions are optimal, since the example give at 
the introduction indicates that, in deterministic settings, nonlinear decision are 
optimal. However, the next result shows how to obtain the linear optimal deci- 
sions by solving a semidefinite program. 



Qj Sj 
ST R 



jm+n 



for 



Theorem 5. Let C t e W p * xn , for i = 1,...,N. Let 

j = 0,...,M, and R 3 e §" 1 for = 1,...,M. Then, the set of quadratic matrix 
inequalities 



X 


T 




Sj' 




X 


KCx 






Rj 




KCx 



<0 Vx, j = 0,...,M, 



(7.1) 



is equivalent to 



Qj + S 3 KC + C T K T SJ C T K T Rj 



-Rj 



RjKC 

Proof. We have the following chain of inequalities 



d 0, i = 0,...,M. 



(7.2) 
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Qj 


Sj' 




X 


KCx 




sj 


Rj 




KCx 



< 
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" I ' 


T 


Qj 


si 




' I ' 


KC 










KC 



-< 



)j + SjKC + C T K T Sj + C T K T RjKC < 



A = 



S J KC + C T K T Sf C T K T Rj 



RjKC 



-R* 



^0, 



where the last equivalence follows from taking the Schur complement of Rj in A 
(see (3l). Hence, our optimization problem becomes 



Qj + S-jKC 



C T K T SJ C T K T R, 



RjKC 



-Ra 



^0, 



0,...,M. 



(7.3) 



This completes the proof. □ 



8. Conclusions. We have studied multi-objective linear quadratic optimiza- 
tion of team decisions in both stochastic and deterministic settings. Constrained 
decision problems tend to have nonlinear optimal solutions. We have shown that 
for the Gaussian setting, linear decisions are in fact optimal, and we can find 
the linear optimal solutions by solving a semidefinite program. We then explore 
the problem of finding the linear optimal decisions for its deterministic counter- 
part and show that we can find the optimal solution by solving a semidefinite 
program. Future work will consider optimality of the linear decisions in the de- 
terministic framework. Another problem of interest is an an 5-procedure sort 
of a result, where we want to find decision function fi such that the inequality 
Jo((J,(x),x) < is satisfied if Ji((j,(x),x) < 0, where Jo, Ji are some quadratic 
forms in fj, and x. However, this is a much harder problem since the search for 
linear function fi(x) is not a covnex problem, and it's not clear if it can be convex- 
ified. 
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Appendix. 

Game theory. Let J = J(u, w) be a functional denned on a product vector 
space U x W, to be minimized by u e U c U and maximized by w € W c W, where 
U and W are the constrained sets. This defines a zero-sum game, with kernel J, 
in connection with which we can introduce two values, the upper value 

J := inf sup J(u,w), 
»£f wew 

and the lower value 

J_ := sup inf J(u, w). 

Obviously, we have the inequality J > J. If J = J = J*, then J* is called the 
value of the zero-sum game. Furthermore, if there exists a pair (w* e U,w* e W) 
such that 

J(u*,w*) = J\ 

then the pair (u*,w*) is called a (pure-strategy) saddle-point solution. In this 
case, we say that the game admits a saddle-point (in pure strategies). Such a 
saddle-point solution will equivalently satisfy the so-called pair of saddle-point 
inequalities: 

J{u*,w) < J(u*,w*) < J(u,w*), Vm € U,Vw € W. 

PROPOSITION 2. Consider a two-person zero-sum game on convex finite di- 
mensional action sets U\ x U 2 , defined by the continuous kernel J{u\, u^). Suppose 
that J{ux,U2) is strictly convex in u% and strictly concave in u 2 . Suppose that 
either 

(i) U\ and Ui are closed and bounded, or 

(ii) Ui C R mi , i = 1,2, and J(ui,u 2 ) — > oo as \\ui\\ — > oo, and J(ui,u 2 ) — > — oo 
as || wall — > oo. 

Then, the game admits a unique pure-strategy saddle-point equilibrium. 
Proof. See Q, pp. 177. □ 

Remark. The assumption of strict convexity and concavity in Proposition [2] 
can be relaxed to only convexity and concavity, and a saddle-point exists in pure 
strategies, but it is not necessarily unique. 



